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(57) Apparatus and methods are disclosed for use 
with an image guided surgical system for displaying an- 
atomical landmarks in registration with appropriate x-ray 
images of the portion of the anatomy being operated up- 
on. The image guided system computer is used to gen- 
erate the desired landmarks from landmark positions in- 
putted by conventional input devices or by a tracked sur- 
gical probe using additional instructions provided to the 
computer memory. Icons are generated and displayed 
using the additional instructions for indicating the posi- 
tion and orientation of tracked surgical instruments rel- 
ative to the landmark and/or an anatomy location refer- 
enced to the landmark. 
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Description 

RELATED APPLICATIONS 

[0001] This disclosure is related to U.S. Patent Appli- 
cation No. 09/274,972 of David A. Simon, Kevin Foley, 
and Kurt R. Smith, filed March 23, 1999, entitled "Nav- 
igational Guidance Via Computer-Assisted Fluoroscop- 
ic Imaging." 

BACKGROUND 

Field of the Invention: 

[0002] The present invention is directed generally to 
image guided surgery and, more particularly, to appara- 
tus and methods of using image guided surgery for land- 
mark-dependent surgical procedures, such as interbody 
fusion device placement. 

Description of the Related Art : 

[0003] Many surgical procedures require the surgeon 
to establish with some accuracy a "landmark" on the pa- 
tients anatomy as a point of reference for aspects of the 
procedure. This is particularly the case, for example, in 
spinal surgery requiring the implantation of interbody fu- 
sion devices, including cage-type and bone dowel-type 
devices, where the desired implantation location is ref- 
erenced to a hypothetical plane oriented with respect to 
the spinal column, termed the "midline plane." The sur- 
geon typically will use this plane as a reference for the 
implantation location of the fusion device, and the man- 
ufacturers of these devices often specify the preferred 
implantation locations with reference to this landmark or 
figure. 

[0004] Current practice for interbody fusion device 
placement involves determining a midline plane of the 
vertebral column by taking multiple fluoroscopic images. 
Once this is determined, a midline is marked with an ink 
pen or equivalent directly on the vertebral body and/or 
disc of the patient and is used by the surgeon to deter- 
mine the "offset," that is, the position to the right or left 
of the midline on which the interbody fusion device will 
be centered. This is usually accomplished by placing in- 
struments, which have built-in offsets, dependent upon 
the gauging size of the fusion devices, on this point, and 
the interbody fusion device offset location is marked with 
the pen. 

[0005] The surgeon then has to mentally construct the 
midline plane through the marked midline in order to es- 
tablish the trajectory passing through the offset position. 
This can be difficult to do and dependent on careful pa- 
tient positioning (i.e., if the patient is not lying completely 
flat on the table, the surgeon may induce this rotational 
error into his mental image of the midline plane). The 
fusion device implantation instrumentation is then man- 
ually positioned on the marked offset location. Instru- 
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ment trajectory orientation is accomplished using multi- 
ple fluoroscopic views to be taken. This may subject the 
patient, the surgeon, and the operating room personnel 
to excessive radiation exposure. 
5 [0006] Techniques are known through which x-ray im- 
ages are used to locate the real-time position of surgical 
instruments in the patient anatomy represented by the 
x-ray image without requiring x-rays to be repeatedly 
taken. By tracking the instrument, the real-time position 
of the instrument in anatomy represented by the x-ray 
image is determined, and a corresponding representa- 
tion of the instrument in the x-ray image is displayed. 
This allows the surgeon to continually observe the 
progress of the surgery without necessitating additional 
x-ray images, thereby reducing the total exposure to the 
patient and operating room personnel. 

SUMMARY OF THE INVENTION 

[0007] It is the object of the present invention to elim- 
inate the need for a surgeon to mark anatomical land- 
marks, such as the midline plane, directly on the patient. 
[0008] It is also an object of the present invention to 
reduce the number of images, and thus amount of radi- 
ation and OR time, needed to properly locate instru- 
ments relative to a landmark. 

[0009] It is a further object to reduce the error in po- 
sitioning surgical instruments relative to such anatomi- 
cal landmarks. 

[0010] It is a still further object to provide near real- 
time instrument position information relative to such an- 
atomical landmarks. 

[0011] It is yet another object to utilize, and enhance 
the capabilities of, image guided surgical systems such 
as are described in the afore-mentioned related appli- 
cation, for interbody fusion device placement. 
[0012] In accordance with the present invention, as 
embodied and broadly described herein, an apparatus 
is provided for use with an image-based surgical system 
to display anatomical landmarks superimposed on an 
image of the anatomy to be operated upon. The image- 
based system includes a computer processor, a display 
device coupled to the processor, and a memory associ- 
ated with the processor and having stored computer in- 
structions that when executed cause the processor to 
display on the display device an image corresponding 
to anatomy on which a surgical procedure is to be per- 
formed. The apparatus includes an interface with the im- 
age-based system processor for inputting one or more 
anatomical landmark positions. The apparatus further 
includes additional computer instructions stored in a 
storage device accessible by the processor. The addi- 
tional instructions when executed cause the processor 
to generate and display on the display device in regis- 
tration with the displayed image, an anatomical land- 
mark corresponding to the one or more anatomical land- 
mark positions. The interface can be selected from a 
keyboard, a mouse, or a light pen. Where the surgical 
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system is an image guided surgical system, the inter- 
face includes a trackable surgical probe. Also, where the 
surgical system is an image guided surgical system hav- 
ing one or more trackable instruments, the additional in- 
structions include instructions that, when executed, 5 
cause the processor to generate and display an icon in- 
dicating the relative position and orientation of a tracked 
instrument relative to the anatomical landmark or to a 
location referenced to the landmark. The processor can 
also overlay iconic representations of the instruments 10 
on the displayed image and landmark. 
[0013] Further in accordance with the present inven- 
tion, as embodied and broadly described herein, the ap- 
paratus for an interbody fusion device placement surgi- 
cal procedure uses an image guided surgical system in- 15 
eluding a computer processor, a display device coupled 
to the processor, and a memory associated with the 
processor and having stored computer instructions that, 
when executed, cause the processor to display on the 
display device an image corresponding to anatomy on 20 
which the surgical procedure is to be performed. The 
apparatus includes an interface for inputting into the 
processor, one or more positions corresponding to a 
midline plane landmark. The apparatus also includes 
additional computer instructions stored in the memory 25 
that, when executed, cause the processor to display on 
the display device in registration with a displayed image 
a midline plane corresponding to the one or more posi- 
tions. 

[0014] Still further in accordance with the present in- 30 
vention, as embodied and broadly described herein, 
there is provided a method of performing surgery using 
an image-based surgical system having a computer 
processor, a display device coupled to the processor, a 
memory associated with the processor having instruc- 35 
tions that, when executed, cause an anatomical image 
to be displayed on the display device. Specifically, the 
method includes the steps of displaying on the display 
device an image of the anatomy to be operated on, in- 
putting into the processor one or more anatomical land- *o 
mark positions, and processing the anatomical land- 
mark positions using additional instructions that, when 
executed, cause the processor to generate and display 
a corresponding anatomical landmark on the display de- 
vice in registration with the displayed anatomical image. 45 
[0015] Where the system is an image guided surgery 
system, the inputting step can include applying a 
tracked surgical probe to the anatomy to be operated 
upon. Also, where the system is an image guided sur- 
gery system having one or more trackable surgical in- 50 
struments, the memory includes instructions that, when 
executed, cause the processor to generate and display 
on the display device, an icon representing the relative 
position and orientation of a tracked instrument relative 
to the displayed anatomical landmark or to a location 55 
referenced to the landmark. The processor also can 
generate and display iconic representations of the in- 
struments overlayed in registration with the displayed 



image and landmark. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[001 6] The accompanying drawings, which are incor- 
porated in and constitute a part of this specification, il- 
lustrate several embodiments consistent with this inven- 
tion and, together with the description, help explain the 
principles of the invention. In the drawings, 

Fig. 1 is a diagram of apparatus in accordance with 
the present invention in use with an image guided 
surgery system; 

Figs. 2A and 2B are schematic x-ray images illus- 
trating true and distorted images, respectively; 
Figs. 3A and 3B illustrate a projective transforma- 
tion in a fluoroscopic C-arm imager; 
Fig. 4 is a flow chart illustrating methods for per- 
forming two-dimensional navigational guidance us- 
ing the imaging system; 

Figs. 5A and 5B are exemplary fluoroscopic x-ray 
images illustrating the iconic graphical overlay of a 
surgical instrument; 

Fig. 6 is a fluoroscopic image including a "cross 

hair" graphical overlay of an instrument; 

Figs. 7A-7C illustrate images of complementary 

views and an axis that relates them; 

Fig. 8 is an image of a lateral view of a patient's 

vertebral disc; 

Fig. 9 is an image of a lateral view of a spinal ver- 
tebra; 

Fig. 10 is a diagram illustrating a system for speci- 
fying a planned trajectory of a surgical instrument; 
Fig. 11 is a flow chart illustrating a method for spec- 
ifying a planned trajectory of a surgical instrument; 
Figs. 12A through 12C are images of a fracture of 
a femur containing two bone fragments; 
Fig. 13 is a flow chart illustrating methods for align- 
ing bone fragments using the imaging system; 
Figs 14A and 14B are images illustrating implanta- 
tion of an inter-vertebral case in the spine of a pa- 
tient; 

Figs. 15A through 15C are images used in the ac- 
quisition of an x-ray view of the medial axis of a ver- 
tebral pedicle; 

Figs. 1 6A and 1 6B are images used to illustrate the 
measurement of out-of-plane angles based on 
fluoroscopic images. 

Fig. 17A shows actual apparatus embodying the 
present invention for interbody fusion device place- 
ment, and Figs. 17B and 17C show corresponding 
A-P and lateral x-ray images obtained by the image 
guided surgery system used by the apparatus of 
Fig. 17A; 

Figs. 18A and 18B correspond to the A-P image in 
Fig. 17B showing two inputted anatomical landmark 
positions and the midline plane generated from the 
inputted positions, respectively, displayed in regis- 
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tration with the image; 
Fig. 19A shows a tracked surgical probe for input- 
ting anatomical landmark positions directly from the 
anatomy of a patient, and Fig. 1 9B shows a midline 
plane generated from the positions inputted in Fig. 
19A displayed in registration with the A-P image; 
Figs. 20A-20E are schematic drawings of trackable 
instruments usable with the apparatus of Fig. 17A 
namely, distractor, working channel, reamer, tap, 
and implant inserter, respectively; 
Figs. 21 A and 21 B through Figs. 25A and 25B cor- 
respond to the A-P and lateral x-ray images of Figs. 
17B and 17C with icons representing the distractor 
position in registration with the image and an icon 
representing relative distance from the offset posi- 
tion, during successive times in the distractor place- 
ment step; 

Figs. 26A and 26B through Figs. 29A and 29B cor- 
respond to the A-P and lateral x-ray images of Figs. 
17B and 17C with icons representing the working 
channel position in registration with the image and 
an icon representing relative distance from the off- 
set position, during a succession of times for a work- 
ing channel placement step; 
Figs. 30A and 30B through Figs. 34A and 34B cor- 
respond to A-P and lateral x-ray images of Figs. 1 7B 
and 1 7C with icons representing the respective in- 
struments position in registration with the image 
and an icon representing relative distance from the 
offset position; during the reaming, tapping, and in- 
terbody fusion device placement steps, and 
Fig. 35 is a flow chart of an interbody fusion device 
placement procedure using a method in accord- 
ance with the present invention. 

[0017] Reference will now be made in detail to em- 
bodiments of the invention, examples of which are illus- 
trated in the accompanying drawings. Wherever possi- 
ble, the same reference numbers will be used through- 
out the drawings to refer to the same or like parts. 

DETAILED DESCRIPTION 

[0018] With initial reference to Fig. 1, there is shown 
schematically apparatus made in accordance with the 
present invention for image guided interbody fusion de- 
vice placement and designated generally by the numer- 
al 2000. Apparatus 2000 enables a surgeon using an 
image-based surgical system to generate and display 
on a monitor or other display device anatomical land- 
marks overlayed or superimposed in registration with 
the display of an acquired or preacquired image provid- 
ed by the surgical system, of the portion of the patients' 
vertebral column on which the fusion body placement 
procedure is to be performed. Used in conjunction with 
an image guided surgery system that can provide real 
time indications of the positioning of "tracked" surgical 
instruments, apparatus 2000 also allows the surgeon to 
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position the instruments relative to the displayed land- 
mark (in this case, a midline plane) or a location refer- 
enced to the midline (e.g., an offset position for fusion 
device placement surgery) as well as to the displayed 
5 true image. While the present invention to be described 
in more detail below is exemplified by a system used for 
interbody fusion device placement, it is not so limited. 

IMAGE GUIDED SYSTEM OVERVIEW 

10 

[0019] Apparatus 2000 is shown in Fig. 1 in use with 
a preferred image guided surgical system 100. System 
100, to be described henceforth in sufficient detail to al- 
low an understanding and appreciation of the present 
15 invention, is explained in greater detail in U.S. Patent 
Application No. 09/274,972 of David A. Simon et al., filed 
March 23, 1 999 and entitled "Navigational Guidance Via 
Computer-Assisted Fluoroscopic Imaging," the entire 
disclosure of which is hereby incorporated by reference. 
However, it must be understood that the invention is not 
confined to use with this particular image guided surgi- 
cal system. 

[0020] Schematically shown in Fig. 1 is a diagram of 
an imaging-based system 100 used to acquire and dis- 
play x-ray images appropriate for the surgical proce- 
dure, such as anterior-posterior ("A-P") and lateral im- 
ages of a spine section for an interbody fusing device 
placement procedure. Imaging system 100 includes a 
fluoroscopic C-arm x-ray imaging device 101 that further 
includes C-arm 103, x-ray source 104, x-ray receiving 
section 105, a calibration and tracking target 106, and 
radiation sensors 107. Calibration and tracking target 
106 includes infrared reflectors (or alternatively infrared 
emitters) 109 and calibration markers 111. System 100 
includes C-arm control computer 115 which allows a 
physician to control the operation of imaging device 101, 
such as setting imaging parameters. 
[0021] One appropriate implementation of imaging 
device 101 is the "Series 9600 Mobile Digital Imaging 
System," from OEC Medical Systems, Inc., of Salt Lake 
City, Utah, although calibration and tracking target 106 
and radiation sensors 107 are typically not included in 
the Series 9600 Mobile Digital Imaging System and may 
have to be added. The "Series 9600 Mobile Digital Im- 
aging System" is otherwise structurally similar to imag- 
ing system 1 00. 

[0022] In operation, x-ray source 104 generates x- 
rays that propagate through patient 110 and calibration 
target 1 06, and into x-ray receiving section 105. Receiv- 
ing section 105 generates an image representing the in- 
tensities of the received x-rays. Typically, receiving sec- 
tion 1 05 comprises an image intensifier that converts the 
x-rays to visible light and a charge coupled device 
(CCD) video camera that converts the visible light to dig- 
ital images. Receiving section 1 05 may also be a device 
that converts x-rays directly to digital images, thus po- 
tentially avoiding distortion introduced by first converting 
to visible light. 
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[0023] Fluoroscopic images taken by imaging device 
101 are transmitted to computer 115 where they may 
further be forwarded to computer 120. Computer 120 
provides facilities for displaying (on monitor 121) saving, 
digitally manipulating, or printing a hard copy of the re- 
ceived images. Three-dimensional images, such as pre- 
acquired patient specific CT/MR data set 1 24 or a, three- 
dimensional atlas data set 1 26 (described in more detail 
below) may also be manipulated by computer 120 and 
displayed by monitor 121. Images, instead of or in ad- 
dition to being displayed on monitor 121, may also be 
displayed to the physician through a heads-up-display. 
[0024] Although computers 115 and 120 are shown 
as two separate computers, they alternatively could be 
variously implemented as multiple computers or as a 
single computer that performs the functions performed 
by computers 115 and 120, In this case, the single com- 
puter would receive input from both C-arm imager 100 
and tracking sensor 130. 

[0025] Radiation sensors 1 07 sense the presence of 
radiation, which is used to determine whether or not im- 
aging device 100 is actively imaging. The result of their 
detection is transmitted to processing computer 120. Al- 
ternatively, a person may manually indicate when de- 
vice 100 is actively imaging or this function can be built 
into x-ray source 104, x-ray receiving section 105, or 
control computer 115. 

[0026] In operation, the patient is positioned between 
the x-ray source 104 and the x-ray receiving section 
1 05. In response to an operator's command input to con- 
trol computer 115, x-rays emanate from source 104 and 
pass through patient 1 1 0, calibration target 1 06, and into 
receiving section 105, which generates a two-dimen- 
sional image of the patient. 

[0027] C-arm 1 03 is capable of rotating relative to pa- 
tient 1 1 0, allowing images of patient 1 1 0 to be taken from 
multiple directions. For example, the physician may ro- 
tate C-arm 103 ) in the direction of arrows 108 or about 
the long axis of the patient. Each of these directions of 
movement involves rotation about a mechanical axis of 
the C-arm. In this example, the long axis of the patient 
is aligned with the mechanical axis of the C-arm. 
[0028] Raw images generated by receiving section 
1 05 tend to suffer from undesirable distortion caused by 
a number of factors, including inherent image distortion 
in the image intensifier and external electromagnetic 
fields. Drawings representing ideal and distorted imag- 
es are shown in Fig. 2. Checkerboard 202 represents 
the ideal image of a checkerboard shaped object. The 
image taken by receiving section 1 05, however, can suf- 
fer significant distortion, as illustrated by distorted image 
204. 

[0029] The image formation process in a system such 
as fluoroscopic C-arm imager 100 is governed by a ge- 
ometric projective transformation which maps lines in 
the fluoroscope's field of view to points in the image (i. 
e., within the x-ray receiving section 105). This concept 
is illustrated in Figs. 3A and 3B. Image 300 (and any 



image generated by the fluoroscope) is composed of 
discrete picture elements (pixels), an example of which 
is labeled as 302. Every pixel within image 300 has a 
corresponding three-dimensional line in the fluoro- 
5 scope's field of view. For example, the line correspond- 
ing to pixel 302 is labeled as 304. The complete mapping 
between image pixels and corresponding lines governs 
projection of objects within the field of view into the im- 
age. The intensity value at pixel 302 is determined by 

10 the densities of the object elements (i.e., portions of a 
patient's anatomy, operating room table, etc.) intersect- 
ed by the line 304. For the purposes of computer assist- 
ed navigational guidance, it is necessary to estimate the 
projective transformation which maps lines in the field 

15 of view to pixels in the image, and vice versa. Geometric 
projective transformation is well known in the art. 
[0030] Intrinsic calibration, which is the process of 
correcting image distortion in a received image and es- 
tablishing the projective transformation for that image, 

20 involves placing "calibration markers" in the path of the 
x-ray, where a calibration marker is an object opaque or 
semi-opaque to x-rays. Calibration markers 111 are rig- 
idly arranged in predetermined patterns in one or more 
planes in the path of the x-rays and are visible in the 

25 recorded images. Tracking targets, such as emitters or 
reflectors 109, are fixed in a rigid and known position 
relative to calibration markers 111 . 
[0031] Because the true relative position of the cali- 
bration markers 111 in the recorded images are known, 

30 computer 1 20 is able to calculate an amount of distortion 
at each pixel in the image (where a pixel is a single point 
in the image). Accordingly, computer 120 can digitally 
compensate for the distortion in the image and generate 
a distortion-free, or at least a distortion improved image. 

35 While not preferred, distortion may be left in the image, 
and subsequent operations on the image, such as su- 
perimposing an iconic representation of a surgical in- 
strument on the image (described in more detail below), 
may be distorted to match the image distortion deter- 

40 mined by the calibration markers. The same calibration 
markers can also be used to estimate the geometric per- 
spective transformation, since the position of these 
markers are known with respect to the tracking target 
emitters or reflectors 109 and ultimately with respect to 

45 tracking sensor 130. A more detailed explanation of 
methods for performing intrinsic calibration is described 
in the references B. Schuele et al., "Correction of Image 
Intensifier Distortion for Three-Dimensional Recon- 
struction," presented at SPIE Medical Imaging 1995. 

50 San Diego, CA, 1995 and G. Champleboux et al., "Ac- 
curate Calibration of Cameras and Range Imaging Sen- 
sors: the NPBS Method," Proceedings of the 1 992 IEEE 
International Conference on Robotics and Automation, 
Nice, France, May 1992, and U.S. Application Serial 

55 Number 09/106,109, filed on June 29, 1998 by the 
present assignee, the contents of which are hereby in- 
corporated by reference. 

[0032] Calibration and tracking target 1 06 may be at- 
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tached to x-ray receiving section 105 of the C-arm. Al- 
ternately, the target 106 can be mechanically independ- 
ent of the C-arm, in which case it should be positioned 
such that the included calibration markers 111 are visi- 
ble in each fluoroscopic image to be used in navigational 
guidance. Element 106 serves two functions. The first, 
as described above, is holding calibration markers 111 
used in intrinsic calibration. The second function, which 
is described in more detail below, is holding infrared 
emitters or reflectors 109, which act as a tracking target 
for tracking sensor 130. Tracking sensor 130 is a real- 
time infrared tracking sensor linked to computer 120. 
Specially constructed surgical instruments and other 
markers in the field of tracking sensor 130 can be de- 
tected and located in three-dimensional space. For ex- 
ample, a surgical instrument 140, such as a drill, is em- 
bedded with infrared emitters or reflectors 141 on its 
handle. Tracking sensor 130 detects the presence and 
location of infrared emitters or reflectors 141. Because 
the relative spatial locations of the emitters or reflectors 
in instrument 140 are known, tracking sensor 130 and 
computer 120 are able to locate instrument 140 in three- 
dimensional space using well known mathematical 
transformations. Instead of using infrared tracking sen- 
sor 130 and corresponding infrared emitters or reflec- 
tors, other types of positional location devices are 
known in the art, and may be used. For example, a po- 
sitional location device may also be based on magnetic 
fields, sonic emissions, or radio waves. 
[0033] Reference frame marker 150, like surgical in- 
strument 140, is embedded with infrared emitters or re- 
flectors, labeled 151. As with instrument 140, tracking 
sensor 1 30 similarly detects the spatial location of emit- 
ters/reflectors 151, through which tracking sensor 130 
and computer 120 determine the three-dimensional po- 
sition of dynamic reference frame marker 1 50. The de- 
termination of the three-dimensional position of an ob- 
ject relative to a patient is known in the art, and is dis- 
cussed, for example, in the following references, each 
of which is hereby incorporated by reference: PCT Pub- 
lication WO 96/11624 to Bucholz et al., published April 
25, 1996; U.S. Patent No. 5,384,454 to Bucholz; U.S. 
Patent No. 5,851,183 to Bucholz, and U.S. Patent No. 
5,871,445 to Bucholz. 

[0034] During an operation, dynamic reference frame 
marker 1 50 is attached in a fixed position relative to the 
portion of the patient to be operated on. For example, 
when inserting a screw into the spine of patient 1 1 0, dy- 
namic reference frame marker 150 may be physically 
attached to a portion of the spine of the patient. Because 
dynamic reference frame 1 50 is in a fixed position rela- 
tive to the patient anatomy, and instrument 140 can be 
accurately located in three dimensional space relative 
to dynamic reference frame 150, instrument 140 can al- 
so be located relative to the patient's anatomy. 
[0035] As discussed above, calibration and tracking 
target 106 also includes infrared emitters or reflectors 
109 similar to those in instrument 140 or dynamic refer- 



ence frame 150. Accordingly, tracking sensor 130 and 
computer 120 may determine the three-dimensional po- 
sition of calibration target 1 06 relative to instrument 1 40 
and/or dynamic reference frame 150 and thus the pa- 

5 tient position. 

[0036] In general, the imaging system 100 shown in 
Fig. 1 assists physicians performing surgery by display- 
ing real-time or pre-acquired images, such as fluoro- 
scopic x-ray images, of patient 1 1 0 on display 121. Rep- 

10 resentations of surgical instruments 140 are overlaid on 
pre-acquired fluoroscopic images of patient 110 based 
on the position of the instruments determined by track- 
ing sensor 130. In this manner, the physician is able to 
see the location of the instrument relative to the patient's 

15 anatomy, without the need to acquire real-time fluoro- 
scopic images, thus greatly reducing radiation exposure 
to the patient and to the surgical team. "Pre-acquired," 
as used herein, is not intended to imply any required 
minimum duration between receipt of the x-ray signals 

20 and displaying the corresponding image. Momentarily 
storing the corresponding digital signal in computer 
memory while displaying the fluoroscopic image consti- 
tutes preacquiring the image. 

[0037] Fig. 4 is a flow chart illustrating methods for 

25 performing two-dimensional navigational guidance us- 
ing system 100 of Fig. 1. The physician begins by ac- 
quiring one or more fluoroscopic x-ray images of patient 
110 using imager 101 (step 400). As previously men- 
tioned, acquiring an x-ray image triggers radiation sen- 

30 sors 107, which informs computer 120 of the beginning 
and end of the radiation cycle used to generate the im- 
age. For a fluoroscopic x-ray image acquired with imag- 
er 101 to be useable for navigational guidance imager 
101, when acquiring the image, should be stationary 

35 with respect to patient 110. If C-arm 103 or patient 110 
is moving during image acquisition, the position of the 
fluoroscope will not be accurately determined relative to 
the patient's reference frame. Thus, it is important that 
the recorded position of imager 1 01 reflects the true po- 

40 sition of the imager at the time of image acquisition. If 
imager 101 moves during the image acquisition proc- 
ess, or if imager 101 moves after image acquisition but 
before its position is recorded, the calibration will be er- 
roneous, thus resulting in incorrect graphical overlays. 

45 To prevent this type of erroneous image, computer 120 
may examine the position information from tracking sen- 
sor 130 while radiation sensors 107 are signaling radi- 
ation detection. If the calibration and tracking target 106 
moves relative to dynamic reference frame 150 during 

50 image acquisition, this image is marked as erroneous. 
(Steps 401 and 402). 

[0038] At the end of the radiation cycle, computer 1 20 
retrieves the acquired image from C-arm control com- 
puter 1 1 5 and retrieves the location information of target 
55 marker 106 and dynamic reference frame 150 from 
tracking sensor 130. Computer 120 calibrates the ac- 
quired image, as described above, to team its projective 
transformation and optionally to correct distortion in the 
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image, (step 403), and then stores the image along with 
its positional information (step 404). The process of 
steps 400-404 is repeated for each image that is to be 
acquired (step 405). 

[0039] Because the acquired images are stored with 
the positional information of the calibration and tracking 
target 106 and dynamic reference frame 150, the posi- 
tion of C-arm 103, x-ray source 104, and receiving sec- 
tion 105 for each image, relative to patient 110, can be 
computed based upon the projective transformation 
identified in the calibration process. 
[0040] During surgery, tracking sensor 130 and com- 
puter 120 detect the position of instrument 140 relative 
to dynamic reference frame 150, and hence relative to 
patient 110. With this information, computer 120 dynam- 
ically calculates, in real-time, the projection of instru- 
ment 140 into each fluoroscopic image as the instru- 
ment is moved by the physician. A graphical represen- 
tation of instrument 140 may then be overlaid on the 
fluoroscopic images (step 406). The graphical represen- 
tation of instrument 140 is an iconic representation of 
where the actual surgical instrument would appear with- 
in the acquired fluoroscopic x-ray image if imager 101 
was continuously acquiring new images from the same 
view as the original image. There is no theoretical limit 
to the number of fluoroscopic images on which the 
graphical representations of instrument 140 may be si- 
multaneously overlaid. 

[0041 ] Figs. 5A and 5B are exemplary fluoroscopic x- 
ray images illustrating the iconic graphical overlay of a 
surgical instrument. Fluoroscopic image 500, shown in 
Fig. 5A, is an image of a lateral view of the lumbar spine. 
Graphical overlay 502 is the iconic overlay of a surgical 
instrument, such as a drill, within image 500. As the phy- 
sician moves the drill, computer 120 recalculates and 
displays the new location of graphical overlay 502. The 
diamond shaped end of overlay 502, labeled as area 
503, represents the tip of the instrument. The physician 
can use image 500 and overlay 502 to visualize the po- 
sition and orientation of the surgical tool relative to the 
patient's anatomy. 

[0042] In certain situations, the physician may wish to 
know where the tip of the instrument would be if the in- 
strument were projected along a line given by the instru- 
ment's current trajectory. Using the system 100 at the 
physician's command, computer 1 20 may calculate and 
display this projection. Area 505 in Fig. 5B is a projection 
of graphical overlay 502. As shown, the "look-ahead" 
trajectory 505 of overlay 502 is displayed in a different 
line style than overlay 502. Computer 120 may vary the 
length of look-ahead trajectory 505 as directed by the 
physician through a suitable computer interface device, 
such as a keypad, mouse, or touch pad. In this manner, 
computer 120 assists the physician in visualizing where 
the instrument would be in the patient if it were advanced 
a predetermined distance in the patient. 
[0043] Although the "look-ahead" technique de- 
scribed above projected the graphical representation of 



the instrument into the image, there is no requirement 
that the instrument's graphical representation be in the 
space of the image for look-ahead trajectory 505 to be 
projected into the image. For example, the physician 
5 may be holding the instrument above the patient and 
outside the space of the image, so that the representa- 
tion of the instrument does not appear in the image. 
However, it may still be desirable to project look-ahead 
portion 505 into the image to facilitate planning of a sur- 

10 gical procedure. 

[0044] When surgical instrument 1 40 is perpendicular 
to the plane of the fluoroscopic image, the graphical 
overlay of the surgical instrument essentially collapses 
to a point, making it difficult to view. To alleviate this 

15 problem, computer 120 may optionally use a different 
graphical representation of instrument 140 when the 
distance in the image plane between the tip and the tail 
of instrument 140 becomes smaller than a fixed distance 
(e.g., 15 pixels). 

20 [0045] Fig. 6 is a fluoroscopic image including graph- 
ical overlay 601 of an instrument extending from a small 
"cross hair image," which represents tip 602 and a larger 
cross hair, which represents tail 603 of the instrument. 
Computer 120 automatically switches between the 

25 cross hair representation shown in Fig. 6 and the 
"straight line" representation shown in Fig. 5. 
[0046] Frequently, the physician would like to acquire 
two complementary fluoroscopic images of the patient, 
such as images from an anterior/posterior view and a 

30 lateral view of the vertebral discs. The complementary 
views are related to one another by a rotation about an 
axis by a particular amount. For example, an anterior/ 
posterior view is related to a lateral view by a 90 degree 
rotation around the axis running parallel through the 

35 length of the patient. When the mechanical axis of rota- 
tion of C-arm 103 is aligned with the axis relating the 
complementary views (e.g., when the mechanical axis 
is aligned with the axis running through the length of the 
patient), the physician can accurately and quickly switch 

40 between the complementary views by simply rotating C- 
arm 103 through the separation of the complementary 
views (usually 90 degrees). Generally, however, the axis 
of rotation of C-arm 103 is not inherently aligned with 
the axis that relates the complementary views, requiring 

45 the physician to perform a series of time consuming trial- 
and-error based adjustments of the fluoroscope's posi- 
tion through two or more axes of rotation. 
[0047] In system 100 software on computer 120 al- 
lows the surgeon to easily adjust the fluoroscope's po- 

50 sition so that one of its mechanical rotation axes such 
as the axis of rotation shown by arrows 108 in Fig. 1 , is 
aligned with the axis of rotation relating the complemen- 
tary views. The surgeon may then acquire the second 
image in the complementary image set simply by rotat- 

55 ing C-arm 103 a certain amount, typically 90 degrees, 
about the aligned axis. 

[0048] Images of complementary views and the axis 
that relates them are illustrated in Figs. 7A-7C. The im- 
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age of Fig. 7A illustrates a lateral view of the patient's 
vertebral disc, in which the view direction (i.e., the direc- 
tion of the central ray of fluoroscopic imager 1 01 ) is ap- 
proximately parallel to the two vertebral end plates, la- 
beled as endplate 705 and endplate 706. Line 702 is the 
projection of the plane substantially parallel to end 
plates 705 and 706. Similarly, the image shown in Fig. 
7B is an anterior/posterior view of the patient's vertebral 
disc, in which the view direction is parallel to plane 702. 
The axis of rotation 704 that spatially relates the image 
view of Fig. 7A and the image view of Fig. 7B is a line 
perpendicular to plane 702. That is, rotating the image 
view of Fig. 7A ninety degrees about the line perpendic- 
ular to plane 702 will result in the image view shown in 
Fig. 7B. Fig. 7C is a three-dimensional representation 
of the anatomy shown in Figs. 7A and 7B. The line per- 
pendicular to plane 702 is shown by axis of rotation 704. 
[0049] Fig. 8 is an image of a lateral view of the pa- 
tient's vertebral disc, similar to Fig. 7A. In Fig. 8, how- 
ever, computer 120 has drawn line 802, which repre- 
sents the projection of a plane that is perpendicular to 
one of the C-arm's mechanical axes. Line 804 repre- 
sents the plane that spatially relates the complementary 
views. With line 802 visible, the physician may adjust 
the position of fluoroscopic imager 101 so that line 802 
is lined up with line 804. At this point, switching between 
the complementary views simply involves rotating C- 
arm 103 about a single mechanical axis. 
[0050] Although the alignment of lines 802 and 804, 
as discussed above, was illustrated using both lines 802 
and 804 drawn on the fluoroscopic image, in practice, it 
may only be necessary to display line 802 in the image. 
In this case, line 804 is mentally visualized by the phy- 
sician. Additionally, although the relation of complimen- 
tary views was discussed using the example of the 
spine, complimentary fluoroscopic images of other an- 
atomical regions, such as, for example, the pelvis, fe- 
mur, or cranium, may similarly be obtained by applica- 
tion of the above discussed concepts. 
[0051] Before, or during, surgery, the physician may 
find it desirable to input an operation "plan" to computer 
120. The plan may, for example, specify a desired tra- 
jectory of a surgical instrument superimposed on a fluor- 
oscopic image. During the surgical navigation process, 
the goal of the surgeon would be to align the graphical 
icon representing the real-time location of the surgical 
instrument with the graphical overlay representing the 
planned trajectory. 

[0052] Fig. 9 is an image of a lateral view of a spinal 
vertebra. Assume the goal of the operation plan is to 
define a line that passes along a desired trajectory within 
the image of the vertebra. One method of accomplishing 
this goal is to directly input the desired trajectory infor- 
mation to computer 1 20 using traditional computer input 
devices. While this method of directly interacting with 
computer 120 is possible, it can be cumbersome and 
disruptive during surgery. Consistent with an aspect of 
the present invention, an alternative method of accom- 



plishing this is for the physician to position the surgical 
instrument on the surface of the bone or skin in the de- 
sired orientation, and then project the tip of the instru- 
ment forward using the previously described look-ahead 
5 technique. More specifically, the desired trajectory is 
specified by (1 ) adjusting the position and orientation of 
the instrument near the patient with virtual look-ahead 
active, and (2) adjusting the length of the virtual look- 
ahead. Fig. 9 illustrates the iconic representation of in- 
fo strument 901 and the virtual look-ahead projection of the 
instrument 902. Once the desired trajectory is achieved, 
the surgeon may direct computer 120 to "freeze" the 
planned trajectory on display 121. The desired trajectory 
can be obtained using one or more C-arm fluoroscopic 
15 images with two or more being required to define a spe- 
cific three-dimensional trajectory which can then be dis- 
played on any C-arm fluoroscopic view. The freeze op- 
eration may be input to computer 120 through, for ex- 
ample, a simple input device such as a foot pedal. The 
20 physician may then proceed with the operation, using 
the overlay of the planned target as a guide. 
[0053] Yet another method consistent with the 
present invention for specifying a planned trajectory of 
a surgical instrument, which, unlike the method dis- 
25 cussed above, does not require positioning the surgical 
instrument on or near the patient's bone, is illustrated in 
Figs. 10 and 11. 

[0054] As shown in Fig. 10, during the acquisition of 
an image, patient 1001 is positioned between C-arm x- 

30 ray source 1 004 and x-ray receiving section 1 006. Fluor- 
oscopic images of patient 1001 are created by the x- 
rays emitted from x-ray source 1 004 as they travel in the 
path generally outlined by cone 1010 through patient 
1001. Line 1011, in the center of cone 1010, corre- 

35 sponds to the origin (i.e., the center point) in the ac- 
quired fluoroscopic images. Physician 1020, standing 
within the range of tracking sensor 1030, but away from 
patient 1001 , commands the computer to create an ex- 
plicit correspondence between the fluoroscope's imag- 

40 ing cone 1010 and a "virtual" cone 1012 at an arbitrary 
position in space (which is visible to the tracking sensor). 
Once this virtual cone has been defined, the surgical in- 
strument 1040 can be projected from this virtual cone 
into one or more pre-acquired fluoroscopic images in the 

45 same manner as if the instrument were located in the 
actual cone 1010 corresponding to a given image. In this 
manner, physician 1020 can plan the trajectory of sur- 
gical instrument 1040 by simply moving the instrument 
in the coordinate system established by the virtual cone. 

so [0055] To define the correspondence between actual 
and virtual cones, it is necessary for the physician to 
define the position of the virtual cone relative to the 
tracking sensor. In general, there are many ways to de- 
fine a cone in space. For example, the position and ori- 

55 entation of a cone can be defined by three points, one 
corresponding to its apex, one corresponding to a sec- 
ond point along its central axis, and a third correspond- 
ing to the rotation of the cone about the central axis. 
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Therefore, one way to define the cone would be to use 
the tip of the surgical instrument to define these three 
points in space relative to the tracking sensor. Another 
way to define this correspondence is to use a single 
measurement of a surgical instrument. Using this meth- 
od, the axis of the instrument corresponds to the axis of 
the cone, the tip of the instrument corresponds to a fixed 
point along the axis of the cone (which could be the 
apex, but could also be another point along the central 
axis), and the orientation of the instrument about its axis 
corresponds to the orientation of the cone about its axis. 
In general any set of measurements which define the 
position and orientation of a given cone can be used to 
establish the correspondence between the actual and 
virtual cones. 

[0056] The operations illustrated in Fig. 10 are shown 
in the flowchart of Fig. 11. To begin the physician holds 
the surgical instrument 1040 in the position that defines 
the virtual cone in the manner as outlined in the previous 
paragraph (step 1101). Computer 120 locates the posi- 
tion of instrument 1040, which effectively corresponds 
the position and orientation of the virtual cone to the ac- 
tual cone (step 1102). Computer 120 projects additional 
movements of instrument 1040 into one or more previ- 
ously acquired fluoroscopic images as if the instrument 
were being moved in the actual cone corresponding to 
a given image (step 11 03). In this manner, the physician 
can align the instrument to particular points or trajecto- 
ries within previously acquired images. At the physi- 
cian's command, computer 120 "freezes" the position 
and/or orientation of the instrument in the displayed 
fluoroscopic image(s) and uses those for subsequent 
processing and plan generation (step 1104) it is also 
consistent with this invention to provide automated plan- 
ning using computer analysis techniques to define an 
"optimal" trajectory in the C-arm images. Once the op- 
timal trajectory is determined, computer 120 overlays 
the optimal trajectory in the fluoroscopic image. For ex- 
ample, automated plans can be generated using com- 
putational techniques to reduce a specified amount of 
lordosis in spine surgery. 

[0057] A common clinical problem, especially in or- 
thopaedic trauma, is the realignment (reduction) of bro- 
ken or misaligned bone fragments. Fig. 12A is a fluoro- 
scopic image of a fracture of the femur containing two 
bone fragments 1201 and 1202. The physician's job is 
to realign the bone fragments so that the femur can 
properly heal. 

[0058] Fig. 13 is a flow chart illustrating methods for 
aligning bone fragments. In general, one of bone frag- 
ments 1201 or 1202 is used as a fixed reference frame 
and the other as a dynamic reference frame. When the 
physician moves the bone fragment corresponding to 
the dynamic reference frame, tracking sensor 130 de- 
tects the movement and updates the x-ray image to re- 
flect the new location of the bone fragment in the patient. 
[0059] To begin the alignment procedure, the physi- 
cian places a tracking sensor marker on each of bone 



fragments 1 201 and 1 202 (step 1 301 ) and acquires the 
fluoroscopic images, (step 1302), such as the image 
shown in Fig. 12A. Computer 120 processes the ac- 
quired image to obtain positional location information 

5 and to calibrate the image (step 1 303, this step is iden- 
tical to steps 401-403 in Fig. 4). 
[0060] After acquisition of the fluoroscopic image(s), 
computer 1 20 uses image detection and extraction tech- 
niques to delineate the boundaries of the bone frag- 

10 ments in the images (step 1304). Suitable edge detec- 
tion algorithms for generating the contours are well 
known in the art, and may be, for example, the Canny 
edge detector, the Shen-Casten edge detector, or the 
Sobel edge detector. An edge detected version of Fig. 

15 12A is shown in Fig. 12B, in which the resulting contour 
corresponding to bone fragment 1 201 is labeled as 1 203 
and the contour corresponding to bone fragment 1202 
is labeled as 1 204. Contours 1 203 and 1 204 may be, as 
shown in Fig. 12B, graphically superimposed by com- 

20 puter 120 on the acquired image(s). 

[0061] Overlaying the detected image contours on the 
fluoroscopic image allows the physician to easily identify 
the correspondence between image contours 1203 
-1204 and bone fragments 1201-1202. The physician 

25 inputs this correspondence into computer 120 (step 
1305). Alternatively, computer 120 may automatically 
identify the correspondence between the image con- 
tours and the bone fragments. Once the correspond- 
ence is established, the physician specifies which con- 

30 tour is to remain fixed and which is to be repositioned. 
The tracking sensor marker attached to the fragment to 
be repositioned is referred to as the dynamic reference 
marker and the tracking sensor marker attached to the 
fixed fragment is referred to as the fixed reference frame 

35 marker, although physically the dynamic reference 
marker and the fixed reference frame marker may be 
identical. 

[0062] During surgical navigation, the physician 
moves the bone fragment having the dynamic reference 

40 marker (step 1306). Tracking sensor 130 detects the po- 
sition of the dynamic reference frame marker and the 
fixed frame marker. With this information and the previ- 
ously generated positional location information, compu- 
ter 120 calculates and displays the new position of the 

45 dynamic reference frame, and hence its corresponding 
bone fragment, in the fluoroscopic image (step 1307). 
Fig. 12C illustrates an updated version of the fluoro- 
scopic image contour 1203 corresponding to the fixed 
bone fragment and contour 1204 corresponding to the 

50 new location of the dynamic reference marker and its 
bone fragment. 

[0063] Methods described above for aligning bone 
fragments may also be applied to the proper alignment 
of multiple vertebral bodies, for example in the reduction 
55 of scoliosis. 

[0064] The navigational guidance system 100 used 
by the present invention is not limited to providing sur- 
gical navigational guidance with two-dimensional fluor- 
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oscopic images. Three-dimensional volumetric data 
sets may also be overlaid with graphical representations 
of a surgical instrument. Three-dimensional data sets 
(such as CT or MRI) may be either pre-acquired or ac- 
quired during the operation. 5 
[0065] Two types of three-dimensional data sets are 
typically used in surgical navigation: patient-specific im- 
age data and non-patient specific or atlas data. Patient- 
specific three-dimensional images are typically ac- 
quired prior to surgery using computed tomography 10 
(CT), magnetic resonance (MR), or other known three- 
dimensional imaging modalities, although intraopera- 
tive acquisition is also possible. Atlas data is non-patient 
specific three-dimensional data describing a "generic" 
patient. Atlas data may be acquired using CT, MR or oth- 15 
er imaging modalities from a particular patient; and may 
even comprise images from several modalities which 
are spatially registered (e.g., CT and MR together in a 
common coordinate system). Atlas data may be anno- 
tated with supplemental information describing anato- 20 
my, physiology, pathology, or "optimal" planning infor- 
mation (for example screw placements, lordosis angles, 
scoliotic correction plans, etc). 

[0066] A three-dimensional patient CT or MR data set 
is shown in Fig. 1 as data set 124 and atlas data is illus- 25 
trated in Fig. 1 as data set 126. Before overlaying a 
three-dimensional image with graphical representations 
of surgical instruments, the correspondence between 
points in the three-dimensional image and points in the 
patient's reference frame must be determined. This pro- 30 
cedure is known as registration of the image. One meth- 
od for performing image registration is described in the 
previously mentioned publications to Bucholz. Three-di- 
mensional patient specific images can be registered to 
a patient on the operating room table (surgical space) 35 
using multiple two-dimensional image projections. This 
process, which is often referred to as 2D/3D registration, 
uses two spatial transformations that can be estab- 
lished. The first transformation is between the acquired 
fluoroscopic images and the three-dimensional image 40 
data set (e.g., CT or MR) corresponding to the same 
patient. The second transformation is between the co- 
ordinate system of the fluoroscopic images and an ex- 
ternally measurable reference system attached to the 
fluoroscopic imager. Once these transformations have 45 
been established, it is possible to directly relate surgical 
space to three-dimensional image space. 
[0067] When performing three-dimensional registra- 
tion, as with two-dimensional registration, imager 101, 
when acquiring the image, should be stationary with re- 50 
spect to patient 1 1 0. If C -arm 1 03 or patient 1 1 0 is mov- 
ing during image acquisition, the position of the fluoro- 
scope will not be accurately determined relative to the 
patient's reference frame. Accordingly, the previously 
described technique for detecting movement of imager 55 
101 during the image acquisition process can be used 
when acquiring fluoroscopic images that are to be used 
in 2D/3D registration. That is, as described, computer 



120 may examine the position information from tracking 
sensor 1 30 while radiation sensors 1 07 are signaling ra- 
diation detection. If the calibration and tracking target 
1 06 moves relative to dynamic reference frame 1 50 dur- 
ing image acquisition, this image is marked as errone- 
ous. 

[0068] It may be necessary to acquire complementary 
fluoroscopic views (e.g., lateral and anterior/posterior) 
to facilitate 2D/3D registration. The techniques previ- 
ously discussed in reference to Figs. 7-8 and relating to 
the acquisition of complementary views can be applied 
here. 

[0069] Once registered, computer 120 may use posi- 
tional information of instrument 140 to overlay graphical 
representations of the instrument in the three-dimen- 
sional image as well as the two-dimensional fluoroscop- 
ic images. 

Hybrid Use of Three-Dimensional and Two- 
Dimensional Image Data 

[0070] The two-dimensional images generated by im- 
ager 101 are not always able to adequately represent 
the patient's bone structure. For example, fluoroscopic 
x-ray images are not effective when taken through the 
length of the patient (i.e., from the point of view looking 
down at the patient's head or up from the patient's feet) 
because the large number of bones that the x-rays pass 
through occlude one another in the final image. Howev- 
er, information required for planning a surgical proce- 
dure which is not otherwise available based on two-di- 
mensional image data alone may be extracted from a 
three-dimensional image data set such as a CT or MR 
image data set. The extracted information may then be 
transferred to the two-dimensional x-ray images gener- 
ated by imager 101 and used in surgical navigation. The 
following examples describe additional methods for us- 
ing three-dimensional and two-dimensional data in sur- 
gical navigation. 

Example 1 : Importing Three-Dimensional Surgical 
Implant Specifications to Two-Dimensional Images 

[0071] Figs. 14A and 14B are images illustrating the 
implantation of an inter-vertebral cage in the spine of a 
patient using the system 100 (but not using the present 
invention). An inter-vertebral cage is a roughly cylindri- 
cal spinal implant that is inserted in the disc space be- 
tween adjacent spinal vertebrae. The physician may find 
it difficult, if not impossible, to choose the appropriate 
length of an inter-vertebral cage based upon two-dimen- 
sional images such as the image of Fig. 14A, 
[0072] Rectangle 1401 represents the projection of 
the cylindrical inter-vertebral cage into the image. While 
the long axis of the cylinder appears to be completely 
within the bone in this image, this may not be the case 
due to curvature of the anterior aspect of vertebrae 
1402. Fig. 14B is an image of a three-dimensional axial 
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CT cross section of the vertebrae. Comer 1403 of rec- 
tangle 1401 protrudes from the bone-a highly undesira- 
ble situation that cannot be reliably detected in x-ray im- 
ages such as that of Fig. 14A. Accordingly, when faced 
with this situation, the appropriate cage length should 5 
be chosen based upon one or more axial CT images, 
such as that in Fig. 14B. Selection of the cage length 
can be performed automatically by computer 120 or 
semi-automatically with the input of the physician. 
[0073] Once the cage length has been determined by 10 
the physician and entered into computer 1 20, the length 
value can then be used by computer 1 20 in properly dis- 
playing the graphical overlay in the associated two-di- 
mensional image. The position of the surgical instru- 
ment used to hold the cage during the insertion process, 15 
as detected by tracking sensor 130, is used to calculate 
the position of the cage in Fig. 14A during the two-di- 
mensional navigational process. 
[0074] Although the above discussed example was 
with a cylindrical spinal implant, in general, the de- 20 
scribed concepts could be applied to any surgical im- 
plant. 

Example 2 : Acquisition of an X-Ray View Down the 
Medial Axis of a Vertebral Pedicle 25 

[0075] In certain clinical procedures, it may be desir- 
able to acquire a fluoroscopic x-ray image view looking 
substantially straight down the medial axis of a vertebral 
pedicle. For the purposes of this example, a vertebral 30 
pedicle can be thought of as a cylinder, and the medial 
axis corresponds to the central axis of the cylinder. 
[0076] Fig. 15A is an x-ray image in which the view 
direction of the imager is aligned with the medial axis of 
the pedicle (i.e. , the medial axis of the pedicle is into the 35 
plane of the image). In this so-called "owl's eye" view, 
the pedicle appears as circle 1501 within the image. It 
is often difficult to precisely acquire this view using only 
fluoroscopic x-ray images, as it is difficult to align the 
view direction of imager 1 01 with the medial axis of the 40 
pedicle using only fluoroscopic images. 
[0077] Given an anterior/posterior fluoroscopic image 
view of the spine, such as the one shown in Fig. 15B, 
and given that the mechanical axis of the fluoroscope is 
aligned with the patient's long axis (i.e., axis 704 in Fig. 45 
7C), an axial CT cross section of a vertebra can be used 
to quickly and easily acquire a high quality owl's eye 
view, such as the view of Fig. 15A. 
[0078] Fig. 1 5C is an image of an axial CT cross sec- 
tion of a vertebra. With this image, computer 1 20 or the 50 
physician may measure angle 1504 between the ante- 
rior/posterior axis 1502 and the projection of the medial 
axis 1503 of the pedicle 1501 into the axial plane. The 
physician may then rotate imager 101 by the measured 
angle about the mechanical rotation axis that is aligned 55 
with the patient's long axis 704. Because most fluoro- 
scopic imagers, such as imager 101, have angle indica- 
tors, rotation by the desired amount is trivial. However, 



if the physician requires additional accuracy in the rota- 
tion, tracking sensor 130, because it detects the position 
of C-arm 103, can be used to more precisely measure 
the rotation angle. 

Example 3 : Use of Digitally Reconstructed 
Radiography in the Placement of a Surgical Implant 

[0079] With conventional fluoroscopic x-ray image ac- 
quisition, radiation passes through a physical media to 
create a projection image on a radiation sensitive film 
or an electronic image intensifies Given a 3D CT data 
set, a simulated x-ray image can also be generated us- 
ing a technique known as digitally reconstructed radiog- 
raphy (DRR). DRR is well known in the art, and is de- 
scribed, for example, by L. Lemieux et al., "A Patient- 
to-Computed-Tomography Image Registration Method 
Based on Digitally Reconstructed Radiographs," Medi- 
cal Physics 2 1 (11), pp 1749-1760, November 1994. 
[0080] When a DRR image is created, a fluoroscopic 
image is formed by computationally projecting volume 
elements (voxels) of the 3D CT data set onto a selected 
image plane. Using a 3D CT data set of a given patient, 
it is possible to create a DRR image that appears very 
similar to a corresponding x-ray image of the same pa- 
tient. A requirement for this similarity is that the "com- 
putational x-ray imager" and actual x-ray imager use 
similar intrinsic imaging parameters (e.g., projection 
transformations, distortion correction) and extrinsic im- 
aging parameters (e.g., view direction). The intrinsic im- 
aging parameters can be derived from the calibration 
process. 

[0081] A DRR image may be used to provide guid- 
ance to the surgeon in the problem discussed in Exam- 
ple 1 of appropriately placing an inter-vertebral cage in 
the patient. Given a 3D CT data set of two adjacent ver- 
tebrae, the physician, interacting with computer 120, 
may manually position a 3D CAD model of an inter-ver- 
tebral cage in a clinically desired position in the three- 
dimensional view of the vertebrae. The physician may 
then use the DRR technique to synthesize an anterior/ 
posterior, lateral, or other x-ray view of the vertebrae 
showing the three-dimensional CAD model of the inter- 
vertebral cage. Thus, a synthetic fluoroscopic x-ray im- 
age can be created which simulates what a properly 
placed cage would look like after implantation. 
[0082] The simulated x-ray images may be compared 
to the actual images taken by imager 101 during sur- 
gery. The goal of the surgeon is to position the implant 
such that the intra -operative images match the DRR im- 
ages. For this comparison, two types of intra-operative 
images may preferably be used. First, conventional 
fluoroscopy could be used to acquire an image after the 
inter-vertebral cage has been implanted. Second, imag- 
es acquired prior to cage placement could be supple- 
mented with superimposed graphical icons represent- 
ing the measured cage position. In either case, the syn- 
thetic fluoroscopic image can be used as a template to 
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help guide the surgeon in properly placing the inter-ver- 
tebral cage. 

[0083] Although the above example was described in 
the context of implanting an intervertebral cage, im- 
plants other than the inter-vertebral cage could also be 
used. 

Example 4 : Obtaining a Particular Two-Dimensional 
View Direction Using Digitally Reconstructed 
Radiograph Images 

[0084] The DRR technique can be used to provide 
guidance to the physician when acquiring an owl's eye 
view of a vertebral pedicle. Given a three-dimensional 
CT data set containing a vertebra and associated pedi- 
cle, the physician may use computer 120 to manually 
locate a three-dimensional representation of the pedi- 
cle's medial axis relative to the three-dimensional imag- 
es of the vertebrae. Once this placement has been 
achieved, it is possible to synthesize an owl's eye view 
of the vertebrae based upon the view direction specified 
by the physician's selection of the three-dimensional 
medial axis. This synthetic image can then be displayed 
to the surgeon during surgery and used to guide the ac- 
quisition of an actual owl's eye view using the fluoro- 
scope. By visually comparing fluoroscopic images taken 
while positioning the fluoroscope to the synthetic owl's 
eye view, the physician can acquire a fluoroscopic im- 
age with a view direction approximately equal to the 
manually selected medial axis. In this manner, a high 
quality owl's eye view can be acquired. 
[0085] Although the above example was described in 
the context of synthesizing a two-dimensional owl's eye 
view, in general, any three-dimensional view direction 
can be selected and a corresponding two-dimensional 
image synthesized and used to acquire a fluoroscopic 
two-dimensional image. 

Example 5 : Measuring Out-Of-Plane Angles Based 
On Fluoroscopic Images 

[0086] It may be desirable to measure the angle be- 
tween the trajectory of a surgical instrument and the 
plane of a fluoroscopic image (such as a plane aligned 
with the mid-line of the spine 1 502) during surgery using 
a pre-acquired fluoroscopic image. This is useful, as it 
is often desirable to position or implant a surgical instru- 
ment at a certain angle relative to the plane of the fluor- 
oscopic image. For example, the surgical instrument 
may need to be implanted in the direction aligned with 
the medial axis of the pedicle 1503. 
[0087] Consider the vertebral cross section shown as 
an axial CT image in Fig. 15C. As described above, the 
angle 1504 between the anterior/posterior axis of the 
spine 1502 and the medial axis 1503 of the pedicle can 
be measured from this CT image. Aligning the surgical 
instrument with the medial axis can be accomplished by 
dynamically measuring the angle between the trajectory 



of the surgical instrument and the plane defined by the 
mid-line of the spine 1 502. When the dynamically meas- 
ured angle matches the angle pre-obtained from the CT 
image, the surgical instrument is aligned. 
5 [0088] Figs. 16A and 16B are figures respectively il- 
lustrating an anterior/posterior fluoroscopic image of the 
spine and a corresponding three-dimensional view of 
the spine. In a manner to be discussed in more detail 
below, the physician defines two points along the mid- 

10 line of the spine, such as the points 1601 drawn on the 
spinous processes in Fig. 1 6A (in non-pathological anat- 
omy a spinous process typically defines the midline). 
Computer 1 20 of system 1 00 uses these points to define 
a line 1 602 in the image, or more precisely, the computer 

15 defines plane 1603 (shown in Fig. 16B) to include the 
two points and the linear projections of these two points 
dictated by the calibration transformation. More intui- 
tively, a first order approximation of plane 1603 can be 
thought of as the plane passing through the two points 

20 perpendicular to the image plane. 

[0089] Plane 1 603 defines the midline of the spine in 
three-dimensional space. During navigational guid- 
ance, the equation of this plane can be expressed in the 
coordinate system of either the dynamic reference 

25 frame 1 50 or the tracking sensor 1 30. 

[0090] Using the tracking sensor 130 to measure the 
position and orientation (i.e., the trajectory) of the instru- 
ment 140, computer 120 then mathematically projects 
this trajectory onto the plane 1603. This projection will 

30 define a line passing through plane 1 603. The angle be- 
tween this line in plane 1603 and the instrument trajec- 
tory corresponds to the angle to be measured. In other 
words, the angle to be measured corresponds to the 
minimum angle present between the trajectory of the in- 

35 strument and the plane 1 603. The angle to be measured 
can be calculated by computer 120 and displayed to the 
physician either in a textual or graphical format. 
[0091] In summary, as described in this example, a 
single fluoroscopic image can be used during surgery 

40 to position a surgical instrument at a desired trajectory 
relative to the plane of the fluoroscopic image. More 
generally, the methods described in this example relate 
to measuring the angle between the trajectory of a sur- 
gical instrument 140 and a plane (e.g. 1603) defined by 

45 two or more points (e.g., 1 601 ) which have been man- 
ually or automatically selected in a fluoroscopic image. 
While the explanation uses a CT for clarity of the exam- 
ple, the measurement and display of the angle can be 
achieved without the use of any 3D image data. 

50 [0092] Although the above five examples used three- 
dimensional patient specific data and not atlas data, in 
certain situations, it may be possible to use a 2D/3D reg- 
istration scheme that registers non-patient specific atlas 
data to patient specific fluoroscopic images using afe- 

55 formabfe registration methods that do not preserve the 
rigidity of anatomical structure during the registration 
process. In this manner, the patient specific fluoroscopic 
images may be used to deform the atlas data to better 
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correspond to the patient and thereby transfer atlased 
knowledge to the patient specific fluoroscopic images. 

Anatomical Landmark Generation and Display 

[0093] In accordance with the present invention, the 
apparatus includes an interface with the system compu- 
ter processor for inputting one or more landmark posi- 
tions to be used by the processor for generating and dis- 
playing the landmark. As embodied herein, and referring 
again to Fig. 1, the interface can include standard, sep- 
arately provided input devices such as device 2010 op- 
erative^ connected to computer 120. Input device 2010 
can comprise, for example, a keyboard, a mouse, or a 
light pen. If the image guided system is already 
equipped with an input device, then the required inter- 
face can comprise suitable input instructions stored in 
the memory 201 8 associated with computer 1 20 or in a 
separately provided, operatively connected memory de- 
vice such as memory device 2026 shown in Fig. 1 . Mem- 
ory device 2026 can be a tape, disk, or separate com- 
puter with associated memory. Alternatively, or addition- 
ally, the required interface can include a trackabte in- 
strument such as touch-probe 2020 depicted schemat- 
ically in Fig. 1 and shown in Fig. 19A. Probe 2020 in- 
cludes LED array 2022 for tracking by sensor 130. By 
the surgeon physically touching the desired landmark 
positions on the patient's anatomy, apparatus 2000 can 
automatically determine the landmark positions in the 
desired coordinate reference frame through the data 
provided by sensor 1 30. Because image guided system 
1 00 can be configured to locate a specific point on probe 
2020 (i.e., the tip 2024), the requisite accuracy can be 
achieved. 

[0094] Further in accordance with the present inven- 
tion, the apparatus also includes additional computer in- 
structions stored in a storage device accessible by the 
image guided surgical system computer that, when ex- 
ecuted, cause the computer processor to generate and 
display the anatomical landmark positions on the dis- 
play device in registration with a displayed anatomical 
image, that is, in the same coordinate reference frame 
as the image. As embodied herein, and with reference 
again to Fig. 1 , apparatus 2000 includes appropriate ad- 
ditional computer instructions stored either in system 
memory 2018 or in separate storage device 2026. 
[0095] As discussed above, the additional computer 
instructions stored in computer memory 201 8 (or in stor- 
age device 2026) cause the computer 120 to generate 
and display the desired landmark, namely the midline 
"plane" 201 6 in Figs. 1 8B and 1 9B. The instructions also 
preferably include instructions for displaying icons or 
other representations of the actual inputted positions 
used to generate the displayed landmark, such as the 
iconic positions 2012 and 2014 shown in Fig. 18A. Also, 
the additional instructions can include instructions to 
store the inputted landmark positions, for example, in 
system memory 2018 or storage device 2026, for future 



reference or record keeping. 

[0096] As discussed previously, the image guided 
surgery system 100 has the advantage of being able to 
track the various instruments (suitably equipped with 

5 LED emitter arrays) that may be required for a surgical 
procedure, and to generate and display on monitor 1 21 , 
icons representing the instruments or parts thereof, e. 

the tip and tail portions, in registration with a dis- 
played anatomical image. Thus, for an interbody fusion 

10 device implantation procedure, trackable instruments 
such as those shown in Figs. 20A-20E can be used with 
system 100 to implant an interbody fusion device, such 
as fusion device 2032 shown mounted on implant insert- 
er 2034 (Fig. 20E), in a manner to be discussed in more 

15 detail henceforth. 

[0097] Correct placement of the device 2032 requires 
the surgeon to locate the instruments relative to the mid- 
line plane 2016 so that a suitable cavity can be formed 
in the vertebral column a predetermined offset amount 

20 to the right or left. This offset distance is often specified 
by the manufacturer based on size, e.g. , diameter, of 
device 2032 but may be selected by the surgeon. Ap- 
paratus 2000 also allows the surgeon to input via an in- 
terface such as input device 2010 the desired offset or 

25 accept a default to manufacturer's offset values which 
can be stored in system memory 2018 (or storage de- 
vice 2026) together with appropriate instructions to cal- 
culate the offset position in the coordinate system of the 
image. This allows tracked instruments to be located 

30 and appropriate iconic representations displayed rela- 
tive not only to the landmark but also to the offset posi- 
tion location itself which is referenced to the landmark. 
[0098] In the present apparatus 2000, further compu- 
ter instructions are provided in system memory 201 8 (or 

35 storage device 2026) to generate and display on monitor 
121, a dual slider bar icon 2036 indicative of the posi- 
tions of the tip and tail of the tracked instrument relative 
to the desired offset position. As shown e.g. in Figs. 21 A, 
slider bar icon 2036 presents iconic representations of 

40 the relative positions of both the tip 2038 (upper track), 
and the instrument tail 2040 (lower track) of distractor 
2050 (See Fig. 20A) with respect to the offset position 
representation 2042. Slider bar icon 2036 provides a 
convenient, real time assessment of the relative posi- 

45 tions while the surgeon is moving the instrument. Icon 
2036 preferably presents the relative positions in en- 
larged or magnified scope for ease of viewing and in- 
creased accuracy, and also can include a midline plane 
representation 2044. The additional instructions in sys- 

50 tern memory 201 8 (or in storage device 2026) also can 
include instructions to generate and display in registra- 
tion with the image, icons corresponding to one or both 
of the tip and tail (icon 2046 shown in Fig. 21 A repre- 
sents the instrument tip). Of course, icons other than a 

55 slider bar-type icon can be used in accordance with the 
present invention to display the relative position infor- 
mation need for the placement procedure. 
[0099] Although not shown, the instructions in system 
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memory 2018 (or in storage device 2026) alternatively 
can provide for the generation and display of iconic rep- 
resentations of the instrument or representative parts, 
such as the tip and tail, and of the offset position itself, 
in registration with the displayed image and the dis- 
played landmark. One skilled in the art would under- 
stand, for example, that when the representations of the 
tip and tail of the instrument were coincident with the 
offset position, the surgeon is assured of both the cor- 
rect positioning and alignment of the instrument relative 
to the offset position and the landmark, such as a midline 
plane. 

Interbody Fusion Device Placement Procedure 

[0100] In accordance with a method consistent with 
the present invention, an appropriate anatomical image 
of the anatomy to be operated upon is first caused to be 
displayed on a display device. As embodied herein and 
with reference to the figures, Figs. 17B and 17C show, 
respectively, anterior-posterior ("A-P") and lateral X-ray 
images obtained using the apparatus shown in 1 7A. The 
apparatus shown in 17A includes apparatus 2000 in use 
with the image guided surgical system 100, as depicted 
schematically in Fig. 1 , including fluoroscopic device 
101 used for obtaining the x-ray images which can be 
processed by the image guided surgical system to pro- 
vide accurate A-P and lateral images. The Fig. 17A ap- 
paratus also includes a dynamic reference array 150 at- 
tached to the spine of the patient which can be sensed 
by sensor 130 (not shown in Fig. 17A). The image guid- 
ed surgical system "knows" the relative location of the 
reference array 150 and the fluoroscope device 101, 
and also has the ability to calibrate the images and 
"learn" the characteristics of the image such that it can 
overlay an icon representing the position of tracked sur- 
gical instruments onto the calibrated images shown in 
Figs. 1 7B and 17C during the actual fusion device place- 
ment procedure. 

[0101] Further, in accordance with the method con- 
sistent with the present invention, the one or more ana- 
tomical landmark positions are inputted into the image 
guided surgical system computer. As embodied herein, 
this step can be accomplished by the surgeon in one or 
the other of two basic ways, namely using input device 
2010 (or using the system's input device via appropriate 
instructions in memory 2018 or storage device 2026), 
or using a tracked surgical instrument like probe 2020. 
In the first alternative, the surgeon can input the coordi- 
nates of the landmark positions into the computer direct- 
ly, such as using a conventional keyboard, mouse, or 
light pen input device that is suitably interfaced with the 
image guided surgery system computer 120. Fig. 18A 
is the A-P image corresponding to Fig. 17B with the 
points 2012 and 2014 selected and inputted by the sur- 
geon superimposed. Fig. 19A shows the alternative 
route to inputting the landmark positions, namely the 
surgeon using tracked surgical probe 2020 in place of, 



or as part of, input device 2010 and physically touching 
the patient's anatomy at the locations that he has se- 
lected as corresponding to the desired anatomical land- 
mark, in this case a midline plane. 

5 [0102] Still further in accordance with the present in- 
vention, the method includes the step of processing the 
inputted anatomical landmark positions using additional 
computer instructions that, when executed cause the 
processor to generate and display a corresponding an- 

10 atomical landmark on the display device and registration 
with the displayed anatomical image. As embodied 
herein, using the inputted landmark positions such as 
points 2012 and 2014, computer 120 in each case then 
would generate midline plane 201 6 that passes through 

15 the two points and is parallel to the imaging direction 
when the A-P image was acquired (i.e., perpendicular 
to the plane of the A-P image). 
[0103] The next step in the placement procedure is 
for the surgeon to select and input an offset position cor- 

20 responding to the desired placement position and orien- 
tation for the interbody fusion device. The disclosed sys- 
tem allows the surgeon to input the desired offset from 
the midline plane such as by keyboard-type input device 
2010 or to accept default values based on the diameter 

25 of the interbody device. In this latter respect, the offset 
position values, such as those suggested by the manu- 
facturer, can be previously stored in memory 201 8 along 
with appropriate additional instructions to select an ap- 
propriate value based on an input of the size/diameter 

30 of the interbody fusion device actually being used by the 
surgeon. Alternatively, the offset position values can be 
stored along with the additional instructions in storage 
device 2026. 

[0104] The next step in the placement procedure de- 
35 vice positioning a distractor, such as distractor 2050 
shown in Fig. 20A, to allow placement of the working 
channel instrument 2052 (Fig. 20B) that will be used to 
automatically guide the other instruments used to pre- 
pare the cavity and insert the actual interbody fusion de- 
40 vice 2032, namely reamer 2054 shown in Fig. 20C, tap 
2056 shown in Fig. 20D, and implant inserter 2034 
shown in Fig. 20E. 

[0105] Specifically, Figs. 21 A and 21 B are the respec- 
tive A-P and lateral views showing the surgeon's first 

45 attempt to bring distractor 2050 into the correct position 
and alignment with the previously established offset po- 
sition. Because of the tracking ability of the image guid- 
ed surgery system, the position of the distractor (repre- 
sented by tip icon 2046) can be displayed on the A-P 

50 view (Fig. 21 A) and line icon 2058 representing the tra- 
jectory and insertion depth of distractor 2050 can be dis- 
played on the lateral view in Fig. 21 B. Both the posi- 
tional and trajectory/orientation representations of the 
distractor, of course, are in registration with the respec- 

55 tive images. 

[0106] As shown in the Fig. 21 A, the present invention 
provides computer instructions for the generation and 
displaying the dual track slider bar icon . 2036 for allow- 
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ing the surgeon to quickly adjust the position and orien- 
tation of the distractor to achieve the correct position and 
alignment relative to the desired offset position. As seen 
in Fig. 21 A, at the beginning of this step the iconic rep- 
resentations of both the tip position 2038 and tail posi- 5 
tion 2040 of the distractor are not coincident with the 
selected offset position, as represented by the bar ele- 
ment 2044. Figs. 22A and 22B, through 25A and 25B 
represent relative positions during movement by the 
surgeon of the distractor to achieve positional and ori- 10 
entation alignment with the desired offset location dur- 
ing successive time periods. Note, for example, that in 
Fig. 24A the icon tip position 2038 alignment has been 
achieved with icon offset position 2042 but that the icon 
tail position 2040 alignment has yet to be achieved. This *5 
would indicate the situation where the tip of the distrac- 
tor is at the desired offset position in the A-P frame of 
reference but that the axial orientation of the distractor 
is not yet aligned. Fig. 25A shows both tip and tail 
aligned coincident with offset position and parallel to the 20 
midline plane. 

[0107] The respective lateral views in Figs. 21 B 
through 25B shows that both tip depth and trajectory in 
the sagittal plane are displayed. This can be achieved 
as a consequence of the dimensions of the various in- 25 
struments, including distractor 2050, being known such 
that the locations of all points on the distractor can be 
computed and displayed based on the sensor sensing 
the LED or reflector array 2060 attached to the distrac- 
tor. Note that in the instruments depicted in Figs. 20A, 30 
and Figs. 20C through 20E, the LED array 2060 is part 
of a universal attachment-type device 2062 to mount 
various working elements (i.e., a distractor element, an 
awl/reamer element, a tap element, and an inserter el- 
ement). See U.S. Patent Application S.N. 08/971,126, 35 
of Kevin T. Foley et al., filed November 20, 1997 entitled 
"An Image Guided Awl/Tap/Screwdriver" for a descrip- 
tion of a suitable universal attachment device. See also, 
U.S. Patent Application No. 09/296,251 (attorney dock- 
et no. 06148.0086-00000) of Thomas R. Williams, filed 40 
concurrently, entitled "Image Guided Universal Tool 
Adaptor and Method for Use With Computer Assisted 
Image Guided Surgery," and U.S. Patent Application 
No. 08/209,248, filed December 10, 1998, entitled "Im- 
age Guided Spinal Surgery Guide System and Method 45 
for Use Thereof." 

[0108] The next step in the placement procedure is 
the installation of the working channel such as working 
channel 2052 shown in Fig. 20B. Working channel 2052 
is intended to fit over the distractor and has its own LED 50 
or reflector tracking array 2064. The particular working 
channel 2052 shown in Fig. 20B has a pair of tines 2066 
radially spaced from the working channel axis 2068 to 
maintain the distraction provided by the distractor. The 
image guided surgical system 1 00 can compute and dis- 55 
play iconic representations of not only the working chan- 
nel (cylinder 2052A), but also the tines (cross hairs 
2066A) to provide the desired rotational orientation of 



the working channel as it is entered into the disk space 
(i.e., tines 2066 should be parallel to the end plates of 
the vertebral bodies). Figs. 26A and 26B through 29A 
and 29B are a series of A-P and lateral x-ray images 
showing successive times during the working channel 
placement step where the surgeon gradually rotates the 
working channel until the positions of the tines are in the 
desired position parallel to the vertebral end plates, as 
in Figs. 28A and 28B. Figs. 29A and 29B represent the 
subsequent insertion of the working channel 2052 to the 
correct depth, as determined principally by the lateral 
view in Fig. 29B. 

[0109] Figs. 30A and 30B through 34A and 34B rep- 
resent the subsequent steps of reaming, tapping, and 
placing the interbody fusion device, such as through the 
use of the instruments shown in 20C, 20D, and 20E op- 
erating through the in-place working channel 2052 
shown in Fig. 20B from which distractor 2050 has been 
removed. Note that the respective lateral views in these 
figures provide the surgeon with an accurate indication 
of the depth of not only the reamer and tap instruments, 
but also of the final placement of the interbody fusion 
device (iconically represented by cylinder 2032A in Fig. 
34B). This latter aspect, of course, is a consequence of 
computer 1 20 "knowing" the location of all points on im- 
plant inserter 2034, including the attached interbody fu- 
sion device 2032, as a consequence of the known di- 
mensions of the inserter and interbody fusion device it- 
self. Like the offset position values, the dimensions the 
interbody fusion devices could be stored in memory and 
available to the computer such that, once selected/des- 
ignated by the surgeon via input device 201 0 or an input 
device provided with system 1 00, the required dimen- 
sions would be available to the computer 120 to gener- 
ate the required coordinate transformations to allow the 
locations of key points on the instrument and interbody 
fusion device, e.g., the tip and the tail, to be generated 
and iconic representations displayed. 
[0110] Fig. 35 is a flow chart summarizing the steps 
of an interbody fusion device placement procedure in 
accordance with the present invention. In particular, 
steps 2080 and 2082 entail, respectively, setting up the 
image guided system 100 and acquiring and displaying 
on monitor 121 the A-P and lateral views of the spinal 
portion of interest. As stated previously, pre-acquired 
images stored in memory 2018 can be used. 
[0111] Next, step 2084 is carried out by inputting the 
coordinates of the midline via input device 201 0 or using 
a tracked instrument like touch-probe 2020. Following 
generation of the midline plane by computer 120 and 
display on monitor 121 in registration with the acquired 
A-P and lateral images, step 2086 is accomplished by 
either inputting the offset position coordinates, such as 
by using input device 2010, or by accepting default val- 
ues stored in memory 2018 (or provided in storage de- 
vice 2026). 

[0112] Next, in step 2088, the surgeon positions a 
tracked distractor, such as distractor 2050 shown in Fig. 
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20A, at the offset position using the image guided sys- 
tem 100 and the displayed offset position and slider bar 
icon 2036. One or more new lateral images of the dis- 
tracted anatomy can optionally be acquired and dis- 
played at this time by system 100, via steps 2090 and 
2092, for subsequent use in positioning the working 
channel. 

[0113] In step 2094, a tracked working channel, such 
as device 2052 (Fig. 20B), is positioned in the anatomy 
at the offset position using system 1 00 and the displayed 
offset position and slider bar icon 2036. The working 
channel positioning step 2094 includes x, y, z position- 
ing, angular, and rotational orientation positioning of the 
working channel, as discussed previously. 
[0114] Next, final step 2096 resulting in placement of 
the interbody fusion device is carried out using image 
guided system 100. Step 2096 includes substeps of 
consecutively positioning a tracked reamer, tap, and in- 
serter, such as the instruments shown in Figs. 20C-20E. 
[0115] Finally, step 2098 includes repeating steps 
2086 through 2096 for placement of a fusion device at 
a corresponding offset position on the opposite side of 
the midline plane, as the devices are usually installed in 
pairs. Of course, if both right and left offset positions 
were inputted during step 2086, then only steps 2088 
through 2096 need to be repeated as comprising step 
2098. 

[0116] The above described apparatus and method 
significantly extend the capabilities and advantages of 
image guided surgical systems, including image guided 
surgical systems used for image guided interbody fusion 
device placement. It would be apparent to those skilled 
in the art that various modifications and variations can 
be made to the present invention without departing from 
the scope or spirit of the invention. As stated previously, 
the advantages and benefits of the present invention are 
not confined to interbody fusion device placement sur- 
gical procedures although it is of particular benefit to that 
surgical procedure. 

[0117] Also, although aspects of the present invention 
are described as being stored in memory, one skilled in 
the art will appreciate that these aspects can also be 
stored on other types of computer-readable media, such 
as secondary storage devices, like hard disks, floppy 
disks, or CD-ROM; a carrier wave from the Internet or 
other propagation medium; or other forms of RAM or 
ROM. 

[0118] While this invention has been variously de- 
scribed generally in connection with LEDs and camera 
arrays, it should be recognized that other tracker ele- 
ments and corresponding sensor arrays known in the 
art could be used, such as for example sonic, optic, or 
electromagnetic, as well as optical reflectors and a cor- 
responding camera system. 

[01 1 9] Other embodiments of the invention will be ap- 
parent to those skilled in the art from consideration of 
the specification and practice of the invention disclosed 
herein. It is intended that the specification examples be 



considered as exemplary only with the true scope and 
spirit of the invention being indicated by the following 
claims. 

5 

Claims 

1. An apparatus for assisting in performing a surgical 
procedure on an anatomy of a patient comprising a 

10 display and a memory both accessible by a proces- 
sor, characterized in: 

image data of the patient stored in the memory 
operable to be displayed on the display; 
'5 a tracking system operable to track a tracking 

sensor associated with an instrument; 

wherein the instrument is operable to be 
tracked by the tracking system with the tracking 
20 sensor for inputting one or more anatomical land- 
mark positions in the patient's anatomy to the proc- 
essor; 

wherein the processor can automatically de- 
termine the anatomical landmark in the image data 
25 operable to be displayed on the display correspond- 
ing to the one or more anatomical landmark posi- 
tions. 

2. The apparatus of Claim 1 , wherein the image data 
30 includes image data produced by a x-ray system, a 

computer aided tomography, a magnetic resonance 
imaging system, a fluoroscope, or combinations 
thereof. 

35 3. The apparatus of Claims 1 or 2, wherein the image 
data includes two dimensional image data, three di- 
mensional image data, or combinations thereof. 

4. The apparatus of any of Claims 1 through 3, where- 
40 in the tracking sensor includes a plurality of tracking 

sensors; 

wherein each of the plurality of tracking sen- 
sors is operable to be tracked with the tracking sys- 
tem. 

45 

5. The apparatus of Claims 1 or 4, wherein the tracking 
system includes an electromagnetic tracking sys- 
tem, an optical tracking system, an infrared tracking 
system, a radiowave tracking system, a radiation 

50 tracking system, an acoustic tracking system, or 
combinations thereof. 

6. The apparatus of Claims 1, 4 or 5, wherein the at 
least one of the tracking system or the tracking sen- 

55 sor includes at least one of an emitter, a reflector, 
and a receiver and the other of the tracking system 
or the tracking sensor includes at least one of an 
emitter, a reflector, and a receiver. 
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7. The apparatus of any of Claims 1 , 4-6 including a 
plurality of the tracking sensors, each attachable to 
a separate portion of the patient. 

8. The apparatus of Claim 7, wherein each of the plu- 
rality of tracking sensors is attached to a separate 
bone fragment, separate bone segment, or combi- 
nations thereof. 

9. The apparatus of any of Claims 1-8, wherein the 
tracking system is operable to track the tracking 
sensor to align a portion of an anatomy of the pa- 
tient. 

10. The apparatus of Claim 9, wherein the portion of the 
anatomy to be aligned includes bone fragments, a 
spinal column, a cranium, or combinations thereof. 

1 1 . The apparatus of Claim 9, wherein the tracking sen- 
sor is attached to a bone segment, the display is 
operable to display an image of the patient based 
upon a location of the tracking sensor tracked by 
the tracking system; 

wherein a user is operable to view the display 
to align the selected portion of the anatomy of the 
patient. 

12. The system of Claim 1 , further comprising a fluoro- 
scopic imaging system operable to image the pa- 
tient. 

13. The apparatus of Claim 12, wherein the fluoroscop- 
ic imaging system includes an intrinsic calibration 
to calibrate an x-ray image obtained of the patient 
to substantially eliminate any distortion when trans- 
forming the x-ray image into a light image. 

14. The apparatus of Claim 12, further comprising: 

a fluoroscopic image control system; and 
a trigger for determining an activation of the ra- 
diation source. 

15. The apparatus of Claim 14, wherein the trigger in- 
cludes a radiation sensor; 

wherein the radiation sensor is operable to 
determine when radiation is being emitted by the 
fluoroscopic imaging apparatus to form an image of 
the patient. 

1 6. The apparatus of Claim 1 5, wherein the fluoroscop- 
ic imaging control system is operable to correct for 
movement of at least one of the patient or the fluor- 
oscopic imaging system based at least in part upon 
a signal produced by the trigger. 

17. The system of Claim 1, further comprising a set of 
instructions useable by the processor to determine 



a boundary of a portion of the patient. 

18. The apparatus of Claim 17, wherein the boundary 
is the anatomical landmark and includes a bound- 

5 ary of a bone fragment, a bone segment, a soft tis- 
sue portion, or combinations thereof. 

19. The apparatus of Claim 17, wherein the processor 
further includes a set of instructions operable to de- 

10 termine an alignment of the outlined portion of the 
anatomy. 

20. The apparatus of Claim 1, wherein the memory is 
operable to store a plan for the surgical procedure 

15 relative to the patient relating to the image data 
stored in the memory. 

21. The apparatus of Claim 20, wherein the surgical 
plan includes a path along which the instrument is 

20 planned to be moved relative to the patient. 

22. The apparatus of Claim 20, wherein the plan is cre- 
ated by a user, created automatically by a proces- 
sor, created in combination with a user and the proc- 

25 essor, or combinations thereof. 

23. The apparatus of Claims 1-3 or 20, wherein the im- 
age data includes atlas image data relating to a ge- 
neric patient. 

30 

24. The apparatus of Claim 23, wherein the surgical 
plan is created with the atlas image data. 

25. The apparatus of Claim 20, wherein the tracking 
35 system is operable to track the instrument; and 

the processor is operable to determine the po- 
sition of the surgical instrument relative to the 
surgical plan regarding the instrument. 

40 

26. The apparatus of Claim 1 , wherein the image data 
stored in the memory includes at least one of image 
data obtained prior to the surgical procedure or im- 
age data obtained during the surgical procedure. 

45 

27. The apparatus of either Claim 1, wherein the ana- 
tomical landmark position comprises a boney proc- 
esses, an edge of an anatomical portion, a protru- 
sion, or combinations thereof. 

50 

28. The apparatus of Claim 27, wherein the image data 
includes at least one of two dimensional image data 
and three dimensional image data and either of the 
two dimensional image data or the three dimension- 

55 al image data is registered relative to the patient. 

29. The apparatus of Claim 1 , 27, or 28, further com- 
prising: 
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a dynamic reference frame operable to main- 
tain the registration of the image data and the 
patient. 

30. The apparatus of Claim 1, further comprising: 

an imaging system; 

wherein the anatomical landmark is an axis 
and the processor is operable to determine the axis 
of an anatomy of the patient from the image data 
stored in the memory; 

wherein the processor is further operable to 
control acquisition of further image data using the 
imaging system based upon the determined axis. 

31 . The apparatus of Claim 30, wherein the determined 
axis includes a medial axis, a lateral axis, a midline 
axis, or combinations thereof. 

32. The apparatus of Claim 30, wherein the imaging 
system is operable to obtain an image relative to 
the determined axis. 

33. The apparatus of Claim 31 , further comprising: 

a device operable to be positioned in the patient 
during the surgical procedure; 

wherein the device includes a dimension. 

34. The apparatus of Claim 33, wherein the dimension 
of the device is stored in the memory; 

wherein the display is operable to display the 
image data and the dimension of the device. 

35. The apparatus of any of Claims 33 and 34, wherein 
the tracking system is operable to track the surgical 
device for display on the display relative to the im- 
age data to display a location of the device relative 
to the patient. 

36. The apparatus of any of Claims 1-3 and 33, wherein 
the memory includes both a three dimensional im- 
age data set and a two dimensional image data set 
of the patient; 

wherein the processor includes a set of in- 
structions for coordinating the two dimensional im- 
age data and the three dimensional image data. 

37. The apparatus of Claim 36, wherein the processor 
is operable to determine a three dimensional vol- 
ume based on the three dimensional image data set 
for display relative to the two dimensional image da- 
ta set on the display. 

38. An apparatus in any of the preceding, character- 
ized in: 



wherein the instrument includes a surgical in- 
strument, a surgical probe, a touch-probe, or com- 
binations thereof; 

wherein the anatomical landmark includes at 
5 least one of a plane, a midline plane, an axis, or 
combinations thereof. 

39. The apparatus of claim 1 or 38, wherein the memory 
is selected from the group comprising: tape, disk, 
10 or separate computer with memory, computer-read- 
able media, hard disks, floppy disks, or CD-ROM, 
a carrier wave from the Internet or other propaga- 
tion medium, RAM, ROM, or combinations thereof. 

15 40. The apparatus of claim 1, 38 or 39, wherein the 
memory is included in at least one of an imaging 
system, the tracking system, a fluoroscopic image 
control system, the display, an image guided appa- 
ratus, or combinations thereof. 

20 

41. The apparatus of claim 1 , or 38 to 40, wherein the 
memory is selected from the group comprising: im- 
age data storage, processor instructions storage, 
atlas image data storage, command instructions 

25 storage, or combinations thereof. 

42. The apparatus of any of the preceding claims 
wherein the anatomical landmark is selected from 
the group comprising: an anatomical point, a plane, 

30 a midline plane, an axis, a boundary of a bone por- 
tion, an edge, or combinations thereof. 

43. The apparatus of any of the preceding claims 
wherein the anatomical landmark position of the pa- 

35 tient's anatomy is selected from the group compris- 
ing: a bone boundary, a pedicle, a boney process, 
a marker, or combinations thereof. 

44. The apparatus of claim 1 , wherein the image data 
40 includes at least one of an A-P image data or a lat- 
eral image data; 

wherein the anatomical landmark position in- 
cludes a point in the anatomy; 

wherein the anatomical landmark includes a 
45 midline plane determined by the processor from the 
tracked position of the instrument. 

45. The apparatus of claim 1 or 45, wherein the instru- 
ment is operable to touch the anatomical landmark 

50 position. 

46. The apparatus of claim 34, wherein the device is a 
spinal cage. 

55 
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